METHOD AND APPARATUS FOR IMPROVING REAL TIME AND/OR 
INTERACTIVE ANIMATION OVER A COMPUTER NETWORK 

This application claims priority from United States Provisional 
5 application no. 60/244,599 filed November 1, 2000. 

Technical Field 

The invention relates to the field of computer-rendered animation and 
10 interactive communication of animation over a computer network, and more 
particularly to methods for improving the timing of interactive computer animation over 
a computer network. 

Background Art 

15 

Communication of interactive computer animation over a computer 
network is widespread, particularly over the Internet in the context of interactive and 
non-interactive animated games or events played or observed by one or more 
participants at client terminals which interact with a game or other application resident 
20 on a server over the Internet. Such animation may correspond both to simulated and 
actually occurring, real world events. Similarly, two or more clients can interact on 
a peer-to-peer basis over the Internet. 

Typically in such animated applications, the server sets a deadline for 
25 the client to render an animation. A server may set such a deadline in a server message 
in both interactive and non-interactive situations . Several such network messages from 
the server may be queued in a stack at the client terminal. The client terminal is busy 
animating earlier messages and may not be able to service the queue. Therefore if time 
is lost at the client in the queue there is less time for the client to make the necessary 
30 decision and the server may move on to the next step in the sequence before receiving 
the client's response. Consequently, over a poor quality network, for example, the 
animation displayed at the client terminal may be jittery due to the uneven timing of the 
arrival of the animation information from the server. 

35 Disclosure of Invention 

The present invention therefore provides a method for improving 
interactive animation over a computer network having a client and a server, compris- 
ing: a) forming a queue of server messages at the client; b) adding received server 
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messages to the queue; c) calculating the minimum deadline of the server messages in 
the queue; d) calculating the time required to play all the currently queued animations; 
and e) if the time required to play all the currently queued animations is greater than 
the minimum deadline of the server messages in the queue, accelerating the animation. 
5 The present invention further provides a computer program product for 

improving interactive animation over a computer network having a client and a server, 
the computer program product comprising: 

a computer usable medium having computer readable program code means 

embodied in the medium for forming a queue of server messages at the client; 
10 the computer usable medium having computer readable program code means 

embodied in the medium, adding received server messages to the queue; 

the computer usable medium having computer readable program code means 

embodied in the medium for calculating the minimum deadline of the server 

messages in the queue; 
15 the computer usable medium having computer readable program code 

means embodied in the medium for calculating the time required to play all the 

currently queued animations; and 

the computer usable medium having computer readable program code 
means embodied in the medium for determining if the time required to play all 
20 the currently queued animations is greater than the minimum deadline of the 

server messages in the queue, and if it is, accelerating the animation. 

Brief Description of Drawings 

25 In drawings which disclose a preferred embodiment of the invention: 

Fig. 1 is a schematic diagram illustrating a computer network for 
carrying out the invention; and 

Fig. 2 is a flowchart illustrating the method of the invention. 

30 Best Modefs) For Carrying Out the Invention 

Fig. 1 illustrates schematically a client terminal 10 communicating over 
a computer network 12 such as the Internet with a server 14. Client terminal has 
application software 16 which permits it to interact with application software 20 on 
35 server 14 which generates , invokes or requests computer animation (the server message 
may include the animations themselves, or it may invoke or request animations cached 
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at the client). In the process of an interactive application between client 10 and 
application software 20, several network messages from the server may be queued in 
the TCP (transmission control protocol) stack at the client terminal. The client terminal 
10 is busy processing, that is, animating, the earlier messages and cannot service the 
5 queue. The time to move from the end to the front of the queue can become many 
seconds in the worst situations due to network jitter etc. In interactive situations such 
as a computer game, the server allows a maximum time for the client to respond and 
if no response is received within that time the server moves on to the next sequence. 
Therefore if time is lost at the client in the queue there is less time for the client to 
10 make the necessary decision. 

The present invention solves the problem by accelerating the animation 
when the client processing falls behind. The client sets a deadline to start processing 
a message x seconds after it arrives, where x is determined by the message. If the 
15 tightest deadline in the message queue is shorter than the time required to process the 
queued animations, the animations will be accelerated to complete within the deadline. 

For each message received from the server but not yet processed, there 
is a deadline Deadline;. The smallest or minimum of these deadlines is Deadline Min . 

20 The time required to play the queued animations is Time Ani m . The Speedfactor is 
defined as Time^n/Deadline^. Ideally the Speedfactor is unlimited, but due to the 
limitations on processing speed and what is visually meaningful to an observer, the 
Speedfactor is limited to some number on the order of 5 or 10 for typical animation 
applications involving human figures. For example, if a maximum of 5 is chosen for 

25 the speed factor to avoid excessive speed of the animation, then if the Speedfactor is 
greater than 1 then the animation is speeded up by a factor of the lesser of the 
Speedfactor and 5. The invention will also work if some other maximum speed factor 
is used, or if no maximum is imposed. If the Speedfactor is not greater than 1, then 
the animations will complete at their normal pace. 

30 

The present invention therefore adds a server message queue to the 
application at the client. All messages from the server are queued there before they are 
acted upon. A network thread or process is added that reads from the network and 
queues messages. The new network thread deteraiines each message deadline, 
35 Deadline^, by examining each command in the queue and the deadline at which each 
message may be processed, and calculates the smallest or minimum of the server 
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message deadlines, Deadline,^. The network thread also calculates Time^,^ the time 
required to play the currently queued animations at a normal rate, and calculates the 
Speedfactor, Time Anim /Deadline Min . The new network thread also manipulates the 
Graphics object to speed animation playback. 

5 

Thus, where the time required to play the queued animations is greater 
than the shortest deadline for responding to a server message, the network thread 
applies a speed factor to the animation by which the animation playback should be 
increased, which is preferably the ratio of the current time required to play the queued 
1 0 animations to that shortest deadline . The increase in the animation playback speed may 
be achieved, for example, by re-interpolation, or other well-known methods. In 
extreme cases where the acceleration of the animation would result in animation that 
does not convey visually meaningful information, the animations may be discarded 
entirely. 

15 

As will be apparent to those skilled in the art in the light of the foregoing 
disclosure, many alterations and modifications are possible in the practice of this 
invention without departing from the spirit or scope thereof. Accordingly, the scope 
of the invention is to be construed in accordance with the substance defined by the 
20 following claims. 



